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TITLE: APPARATUS FOR MANAGING THE INSTALLATION OF 
SOFTWARE ACROSS A NETWORK 

FIELD OF THE INVENTION 

5 The present invention relates to automated software 

installation, in particular to a method and to a device 
for installing software in a data network. 

BACKGROUND OF THE INVENTION 

Software deployment across a network is a time 

10 consuming task. When a network has a very large number of 
nodes, the installation of a software product on all the 

Q nodes or on a large subset of the nodes is done mostly 

"r: manually, which is time consuming and prone to 

O installation errors. This places network operators that 

j ; i 15 manage large networks at a disadvantage when a software 

^ upgrade must be performed across the network. For 

* example, it is estimated that performing a software 

^ upgrade on a network that contains in excess of 10,0 00 

M nodes may require no less than 10 months . 

pi 20 

H Accordingly, there is a need in the industry to 

provide solutions for automating, at least in part, the 
installation of software in a network such that the 
installation can be completed faster than what is done 
25 currently with existing methods. 

SUMMARY OF THE INVENTION 

In a broad aspect the invention provides a software 

installation manager for use in a data network. The data 
network includes a set of nodes having a topology 
30 characterized in that a message directed from a first node 
of the set to a third node of the set passes through a 
second node of the set. 
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The software installation manager includes a control 
entity that exchanges messages with individual nodes of 
the set for causing installation of at least one software 
product on the nodes of the set in parallel according to a 
5 non-blocking sequence. The non-blocking sequence is 
characterized in that the installation of a software 
product on one node of the set does not block the 
installation of the software product on another node of 
the set. 

10 

The principal advantage of this apparatus over prior 
art software installation techniques resides in the 
HI ability to conduct the installation of the software 

Si product in parallel across several nodes of a data network 

^ IS where messages directed to one node transit through 

p another node. The ability to perform the software 

111 installation in a non-blocking fashion across the nodes 

L significantly reduces the time required to deploy the 

lUJ software product , in particular when the deployment has to 

7 U 20 be made over a large nuinber of nodes. 

U 

ij:;i:|s 

For the purposes of this specification, the 
expression Nx installation in parallel" does not imply that 
all the steps or stages of the installation of the 

25 software occur at the same time for all the nodes. 
Rather , this expression should be interpreted broadly to 
mean that a certain step of the installation process at 
one node happens at the same time the same step, or a 
different step of the installation process, is being 

30 conducted at another node. 

For the purposes of this specification, the 
expression vv software product" should be interpreted 
broadly to include application software, operating system 
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software, hardware drivers, software loaded on a hardware 
platform, software upgrades, and so on. 

In a specific non-limitative example of 
5 implementation of the invention, the software installation 
manager is controlled by a network manager entity, When an 
operator initiates at the network manager entity a 
software upgrade process, say through a Graphical User 
Interface (GUI) , the network manager issues control 
10 messages to the software installation manager. In 
response to the control messages, the control entity of 
the software installation manager issues messages to the 
'j;J nodes of the set where the software product is to be 

installed. The messages convey commands that direct the 
W 15 software installation on each node. The order of some of 

H the commands is selected according to a non-blocking 

III sequence, to avoid one node blocking the installation of 

U the software product on another node. The non-blocking 

W sequence can be fixed, having been previously established 

ry 20 on the basis of the network topology in which the 

° installation is performed. Alternatively, the non- 

blocking sequence is dynamically established to suit 
changing environments. At this end, the control entity 
has a node sequencing entity that determines the non- 
25 blocking sequence based on the number of communication 
hops between each node of the set of nodes and a point of 
reference in the data network. 

One of the commands sent to the nodes of the set 
30 according to the non-blocking sequence is a command to 
cause the nodes to reboot. Usually, this is done to 
activate the software product being installed. The use of 
the non-blocking sequence prevents a situation where a 
message commanding a certain node to reboot fails to reach 
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its destination because the message is blocked by another 
node in the process of rebooting (a node in the process of 
rebooting loses message passing capability) . 
Advantageously, the messages are sent such that at least 

5 some of the nodes of the set perform coincident rebooting 
and preferably all of the nodes of the set perform 
coincident rebooting. By w coincident" , it is meant that 
when one node has reached some arbitrary phase of the 
rebooting process, at that same point in time another node 

10 is also undergoing rebooting. To be NX coincident" the 
rebooting of the nodes needs not begin at the same time, 
end at the same time or reach certain phases at the same 
time . 

15 The control entity keeps track of the progress of the 

software product installation on each node and documents 
relevant events in a log- The log is conveyed to the 
network manager such that the information can be displayed 
to the network operator. 

20 

The invention also provides a method for performing 
software product installation in a data network. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A detailed description of examples of implementation 

25 of the present invention is provided hereinbelow with 
reference to the following drawings, in which: 

Figure 1 is a functional block diagram of a data 
network including software installation managers according 
30 to an embodiment of the present invention; 

Figure 2 is a more detailed block diagram of the 
software installation manager shown in Figure 1; 
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Figure 3 is block diagram of the software 
installation manager in accordance with a variant; and 

5 Figure 4 is a flowchart illustrating the sequence of 

even ts taking place when the software installation manager 
shown in Figure 1 installs software at one or more nodes 
of the data network. 

10 la the drawings, embodiments of the invention are 

illustrated by way of example. It is to be expressly 
understood that the description and drawings are only for 
purposes of illustration and as an aid to understanding, 
and are not intended to be a definition of the limits of 

15 the invention. 

DETAILED DESCRIPTION 

Figure 1 illustrates a data network 10. The data 
20 network 10 transports digitized information such as data/ 
voice or video among others. The data network includes a 
plurality of nodes connected to one another by 
communication links also called xv hops" - A single node is 
usually in the form of a workstation or server, while a 
25 communication link can be implemented by a physical signal 
conductor, such as a metal cable or optical fiber, or the 
air interface allowing a wireless transmission. 

In one example of implementation, the data network 10 
30 may be a telecommunications network where the 
communication links are optical links that use the SONET 
communication protocol. The nodes may be designed to 
provide a message passing/routing functionality and signal 
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amplification in addition to other more specific tasks. 
The data network 10 includes a node 12 that implements a 
network manager 14* The network manager 14 is an entity 
at which a human operator can control the data network 10 
5 through a user interface whose function is to receive 
operator commands and deliver information to the operator. 
Advantageously, the user interface is a Graphical User 
Interface (GUI) - The user can enter commands through any 
suitable input device, such as a keyboard, pointing 
10 device, touch screen, voice commands or any other suitable 
device. Information delivered by the user interface is of 
visual nature presented on a screen. In addition, the 

B visual information can be supplemented with audible 

fy information. 

O The network manager 14 makes available to the 

operator data descriptive of the network 10, In general, 
s this data contains information about the structure of the 

jjTjj network. In one specific example of implementation, the 

H 20 data descriptive of the network 10 contains information 

S about the various nodes and subnetworks that form the data 

N network 10. The information about the nodes and 

subnetworks may include the list of the nodes and 
subnetworks, namely their identifiers such as labels 
25 and/or IP addresses and the number of nodes in each 
subnetwork, among other type of information. The data 
descriptive of the data network 10 may also include 
information about the current software releases running on 
each node and subnetwork, the hardware components 
30 connected to each node and subnetwork, or any other 
suitable information - 

The information about the structure of the data 
network 10 is displayed to the operator through the user 
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interface. The manner with which the data descriptive of 
the network can be displayed by the user interface can 
vary widely. In a specific example, the user interface 
shows a list of subnetworks and their associated labels. 
5 Optionally, the user can select any one of the entries in 
that list to expand the information associated with the 
entry and show additional details of the particular 
subnetwork, such as individual nodes of the subnetwork. 

10 The data network 10 also comprises a plurality of 

Subnetwork Management (SM) nodes 16, 18, One function of 
the SM nodes 16, 18 is to direct the installation of a 
software product on a respective set of nodes* Figure 1 
shows that the SM node 16 is associated with a set of 

15 nodes 20 while the SM node 18 is associated with a 
different set of nodes 22. The set of nodes 20 has four 
nodes namely nodes 24-30. The set of nodes 22 also has 
four nodes 31-36. 

20 The topology of the sets of nodes 20 and 22 is* such 

that messages directed to one node of a set transit 
through another node of the set. Examples of this 
topology includes a linear network, a ring network,, a tree 
network and a network that is a combination of two or more 

25 of the previous categories, among others. The set of 
nodes 20 is constructed according to a linear network 
topology, while the set of nodes 22 is constructed 
according to a tree network. 

30 Figure 2 provides a detailed functional block diagram 

of an SM node 16- The functional block diagram of the SM 
node 18 is identical. The SM node 16 performs the 
function a software installation manager 38 that is 
implemented as a program element executed by the computing 
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device forming the SM node 16. The program element exists 
physically on a computer readable storage medium* The 
memory in the computing device of the SM node 16 is an 
example of a computer readable storage medium. The 
5 computer readable storage medium may take different forms 
without departing from the spirit of the invention. 

The software installation manager 38 includes two 
main components, namely a control entity 40 and an 

10 Input/Output port (I/O) 42 that constitutes a point 
through which the control entity 40 can exchange messages 
with the external world, such as the network manager 14, 
the nodes 24-30 or any other node of the data network 10. 
The control entity 40 includes two sub-components, namely 

15 a message generation entity 4 6 and a node sequencing 
entity 48. The main function of the message generation 
entity 4 6 is to produce the messages that are directed to 
the nodes 24-30 to direct the installation of the software 
product on them. The main function of the node sequencing 

20 entity 4 8 is to determine a non-blocking sequence 
according to which at least some steps of the software 
product installation will be made on the nodes 24-30, such 
that the installation of the software product on one node 
24-30 blocks the installation of the software product on 

25 another node 24-30. 

The embodiment of the software installation manager 
38 shown in Figure 2 is under the direct control of the 
network manager 14- In this example the network manager 
30 14 is the master and the software installation manager 38 
is the slave. The operator at the QUI of the network 
manager 14 commands the beginning of the software 
installation process. At this end, the network manager 14 
will produce control messages that are sent to each SM 
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node IS, 18. When an SM node 16/ 18 receives the control 
message, it initiates the local software installation 
process limited to the nodes under its control . 

5 Figure 3 illustrates a variant of the software 

installation manager, identified by the reference numeral 
50. The difference with the previous embodiment resides 
in the presence of a GUI interface 52 that allows an 
operator to locally control the software installation 

10 manager 50 rather than through the intermediary of the 
network manager 14- Evidently, both functionalities can 
be implemented together, such that the software 
installation manager can respond to the network manager 14 
and also possess a GUI interface 52 for local control when 

15 such necessity arises. 

A detailed example of operation of the software 
manager 38 will now be described in connection with the 
flowchart of Figure 4. At step 54, the operation starts. 

20 At step, 56 the operator enters commands on the user 
interface of the network manager 14 to select the 
particular software product that is to be installed. At 
step 58, the operator enters commands on the user 
interface to specify on which nodes of the data network 10 

25 the software products are to be installed* Assume for the 
sake of this example that nodes 24-30 and 31-36 are 
selected. At step 60, the network manager constructs 
control messages and forwards the control messages to SM 
nodes 16, 13. Each SM node 16, 18 receives a dedicated 

30 set of such control message (s), where each control 
message (s) specifies the software product to be installed, 
the source of the load files of the software product, the 
nodes on which the installation is to made, among other 
possible information . 
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At step 62, each SM node 16, 18 receives the control 
message (s) through I/O 42. Each SM node 16, 18 handles 
the control message (s) in the same way. For simplicity 
5 only the steps in connection with SM node 16 will be 
described and reference to the SM 18 will be made only to 
illustrate features unique to that node. 

The installation of the software product performed 
10 under the direction of the SM node 16 can be generally 
divided in five main stages. Those stages are: 

1. Order nodes into non-blocking sequence; 

2. Download catalogue file from server to nodes; 
3* Download load files from server; 

15 4. Activate nodes to software product; 

5. Commit nodes to software product. 

It should be expressly noted that the above sequence 
of stages can be altered without departing from the 
20 invention. Such alterations include the omission of one 
or more steps, the addition of one or more steps or a 
change in the sequence of the steps. 

At step 64, the node sequencing entity determines the 
25 non-blocking sequence according to which the installation 
of the software product is to be made. The non-blocking 
sequence can be established in several ways. A first 
possibility is to use a fixed, non-blocking sequence that 
has been predetermined according to the current node set 
30 topology- A second possibility is to dynamically 

determine the non-blocking sequence. This can be done by 
ordering the nodes 24-30 on the basis of the number of 
communication hops between the node and a certain point of 
reference. In this example, the point of reference is the 
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SM node 16- The number of communication hops to the nodes 
30, 28, 26 and 24 is respectively 4, 3, 2 and 1, In the 
case of the SM 18, the point of reference is the SM node 
18 and number of communication hops to the nodes 36, 34, 
5 32 and 31 is respectively 3, 3, 2 and 1. 

Several possibilities exist to establish the number 
of communication hops from a point of reference to a 
certain node. One such possibility is for the SM node 16 

10 to obtain from the network manager 14 information on the 
topology of the data network 10, from which the 
information on the number of communication hops to a point 
of reference can be extracted. Another possibility for 
the SM node 16 is to send to each node 24-30 a query 

15 message to prompt the node 2 4-30 to generate a response 
message indicative of the number of communication hops 
between the node and the point of reference* 

Several possibilities exist as to the selection of 
20 the point of reference. One possibility, mentioned 
earlier, is to consider the SM 16 as the point of 
reference- This is done because the configuration of the 
set of nodes 20 is such that messages exchanged between 
any one of the nodes 24-30 and the external world (a node 
25 external to the set of nodes 20) must transit through the 
SM 16. A more complex situation arises when the set of 
nodes 20 is not restricted to communicate with the 
external world through a single node. Assume for the sake 
of this discussion that the set of nodes 20 can 
30 communicate with the external world though two points of 
entry/exit, one being the SM node 16 and one being another 
node (not shown) . If during the software installation 
process, messages directed to the nodes 24-30 will transit 
through either one of the points of entry/exit then the 
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establishment of the non-blocking sequence may require 
taking in consideration a second point of reference. 

In general, the present invention is not restricted 
5 to a particular non-blocking sequence or a particular 
algorithm or method for determining the non-blocking 
sequence given a certain network topology. The person 
skilled in the art will appreciate that a large number of 
possibilities exist, other than those presented in this 
10 specification, to establish a non-blocking sequence such 
that the software installation on one node does not block 
the software installation on another node. 

CO Once the node sequencing entity 48 has established 

;"p 15 the non-blocking sequence, this data is passed at step 66 

p to the message generation entity 4 6. 

JL In general, steps 66 and 64 correspond to stage 1 of 

hi the software product installation. 

Q At step 68, that corresponds to stage 2 above, the 

r " message generation entity 46 will send messages to the 

nodes 24-30 to convey a first command. The first command 
directs the nodes 24-30 to fetch a catalogue of files from 
25 a file server in the data network 10. Assume for the sake 
of this example that the file server is implemented by the 
SM node 16. Here the messages are sent without following 
the non-blocking sequence since during the catalogue 
fetching operation each node 24-30 retains its message 
30 passing capability, thus one node does not block messages 
directed to downstream nodes. The messages conveying the 
first command are sent in rapid sequence to the nodes 24- 
30 such that the nodes are instructed at about the same 
time to initiate the catalogue fetching operation. The 
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catalogue fetching operation occurs concurrently on the 
nodes 24-30. Also, the control entity 40 starts to log 
relevant events. One of these events is the dispatch of 
the first command/ and whether or not each node has 
5 acknowledged receipt and/or completion of the directives 
to fetch the catalogue of files. 

The control entity 40 will not wait indefinitely for 
a node 24-30 to respond. After a timeout period, the non- 
10 responding node 24-30 is considered as "failed" and an 
entry to this effect is entered in the log. 

At step 70, corresponding to stage 3 above, the 
P message generation entity 46 issues messages to nodes 24- 

IS 30 (except the nodes previously marked "failed") to convey 
Jr a second command which directs the individual nodes 24-30 

« to fetch the files in the catalogue of files obtained 

if ""jl 

u\ earlier. Those files are the load files from which the 

H software installation will proceed. As with the first 

□ 20 command, the messages conveying the second command are 

r " sent without following the non-blocking sequence since 

during the files fetching operation each node 24-30 
retains its message passing capability. Each node 24-30 
(except any node previously identified as vx failed") is 
25 expected to acknowledge the reception of the second 
command and/or completion of the files fetching operation. 
After a timeout period, nodes that have not responded are 
marked "failed" in the log. 

30 As with the first command, the messages conveying the 

second command are sent in rapid sequence to the nodes 24- 
30 such that the nodes are instructed at about the same 
time to initiate the file fetching operation. The file 
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fetching operation occurs generally concurrently on the 
nodes 24-30. 

At step 72 that corresponds to stage 4 above the 

5 message generation entity 46 issues messages to nodes 24- 
30 to convey a third command which directs the individual 
nodes 24-30 to activate the new software product. In 
practice, this is effected by rebooting the nodes 24-30. 
Since during rebooting the nodes lose their message 

10 passing capability the non-blocking sequence is followed. 
The message generation entity 4 6 will first issue a 
message with the third command to the node 30 only and 
follow with a message with the third command to the node 
28 only when the node 30 has acknowledged reception of the 

15 third command. This sequence continues with the message 
containing the third command being sent to the node 26 and 
finally to the node 24* Again, any relevant events are 
noted in the log. In practice, all the messages 
containing the third command are sent over a short time 

20 period, say a few seconds, while the rebooting takes 
several minutes. By following the non-blocking sequence, 
coincident rebooting of the nodes 24-30 can be 
accomplished, thus allowing saving a significant amount of 
time. 

25 

For the SM 18, the sequence of the third command 
dispatch is as follows. The message containing the third 
coiumand is sent to the nodes 34 and 36 at the same time. 
The sequence continues with the message containing the 
30 third command being sent to the node 32 after the nodes 34 
and 36 have acknowledged reception of the third command. 
Finally the third command is sent to the node 31, after 
the node 32 has acknowledged reception of the third 
command. 
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At step 74 that corresponds to the stage 5 above, the 
message generation entity 46 issues messages to nodes 24- 
30 to convey a fourth command which directs the individual 

5 nodes 24-30 to commit to the new software. During the 
committal, the files relating to any previous version of 
the new software product software are erased such that the 
node cannot be returned to the previous version of the 
software product. Here the non-blocking sequence is not 

10 used since during the committal the nodes maintain their 
message passing capability. Evidently, the non-blocking 
sequence may be used if desired or if during the committal 
the message passing capability of the nodes is lost. 

15 The software installation process is now completed 

and the control entity sends the log through an 
appropriate message to the network manager 14 such that 
the information in the log can be displayed to the network 
operator, identifying the nodes on which the installation 

20 of the software product was successful and the nodes where 
a failure occurred, with information about the reason of 
the failure. 

The messages described earlier can be based on a 
25 variety of protocols. Connection oriented protocols can 
be used, such as Transmission Control Protocol Internet 
Protocol (TCPIP) , Common Management Information Protocol 
(CHIP) and Simple Network Management Protocol (SNMP) - 
Also connectionless protocols can be used such as User 
30 Datagram Protocol Internet Protocol (UDPIP) . Other 
protocols can also be used without departing from the 
spirit of the invention. 
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Although various embodiments have been illustrated, 
this was for the purpose of describing, but not limiting, 
the invention. Various modifications will become apparent 
to those skilled in the art and are within the scope of 
5 this invention, which is defined more particularly by the 
attached claims. 



